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Abstract 

We study local features, and provide a topological insight into the 
global structure of the probability density distribution and of the pat- 
tern of the optimal paths for large rare fluctuations away from a stable 
state. In contrast to extremal paths in quantum mechanics, the optimal 
paths do not encounter caustics. We show how this occurs, and what, 
instead of caustics, are the experimentally observable singularities of 
the pattern. We reveal the possibility for a caustic and a switching 
line to start at a saddle point, and discuss the consequences. 

The problem of large occasional fluctuations in nonequilibrium systems 
is of substantial general interest and importance. These fluctuations form 
the tails of statistical distribution, give rise to escape from a stable state, 
and are responsible for the onset of many effects investigated in various 
areas of physics — some recent examples are stochastic resonance and 
transport in ratchets |2|. One of the basic concepts in the analysis of large 
fluctuations is optimal path — the path along which the system moves, 
with overwhelming probability, on its way to a given point remote from 
the stable state. Optimal paths are experimentally observable, and have 
been an object of active study for the last 20 years (see 1^, ^ for a review). 
They play, in the context of fluctuations, the same role as trajectories for 
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dynamical systems, and therefore understanding the pattern of the optimal 
paths is a key to understanding large fluctuations. 

From the formal point of view, optimal paths are similar to the ex- 
tremal paths in quantum mechanics since both provide an extremum to the 
integrands in the appropriate path integrals. A well-known feature of the 
pattern of the extremal paths is the occurrence of caustics . Caustics have 
also been revealed numerically in the pattern of optimal paths for fluctu- 



ating systems of various types H - |11]. For quantum mechanical systems 



the physical meaning of caustics is well understood — a semiclassical wave 
function is oscillating on one side of a caustic and exponentially decaying 
(or increasing) on the other side. In contrast, the probability density distri- 
bution, which is determined by the optimal paths, is nonnegative definite. 
Therefore it cannot be continued beyond a caustic, and it follows that caus- 
tics may not be encountered by these paths. 

In the present paper we address the problem of avoidance of caustics by 
the physically meaningful optimal paths, and of the global structure and 
the observable singularities of the pattern of these paths. The physical and 
topological arguments we apply are quite general, but as an illustration of 
how they work we consider the simplest case, that of a two-variable system 
performing Brownian motion described by the stochastic equation 

q^ = K,{ci)+Ut), q=(5i,g2), te(t)) = 0, (1) 
mMt')) =D5ij6{t-t'), i,j = 1,2. 

Here, ^(t) is Gaussian white noise. The drift coefficients Ki^2 are assumed 
nonsingular for finite q. 

We assume noise intensity D to be small. In this case if the system is 
prepared initially within the basin of attraction of an attractor a, it will 
most likely approach the attractor in a characteristic relaxation time treb 
as if there was no noise. Then it will perform mostly small fluctuations 
about the position of the attractor q^, so that over t^^l a (quasi)stationary 
probability density distribution /9a(q) will be formed. Large fluctuations 
occasionally bring the system to points q remote from q^, and thus form 
the tails of Pa{<i)- To logarithmic accuracy @ 

Paiq) = const X exp{-Sa{q)/D), (2) 
where 5'a(q) is given by the solution of the variational problem 
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5a(q)=min/ £(q(t), q(t)) dt, 



(3) 



>C(q,q) = ^(q-K)^ q(-oo)=qa, q(0) = q. 

Eq.(3) defines the optimal (most probable) path qopt(i) to a point q from 
the stable position q^ (K(qa) = 0), in the small vicinity of which the large 
fluctuation starts. The optimal path can be associated with the trajectory 
of an auxiliary four- variable (two coordinates, qi^2i ^-nd two conjugate mo- 
menta, pi,2) Hamiltonian system, with the action ^^(q) and Lagrangian C 
(3), and with the respective Hamiltonian Ti. = ^p'^ -|-pK. The Hamiltonian 
equations of motion for the trajectories are of the form 

q = K + p, p = -(pV)K-px (VxK), (4) 

where these trajectories lie on the energy surface E = Q. 

The approximation (2) is similar to the WKB approximation in quantum 
mechanics, with the noise intensity D corresponding to ih. As in quantum 
mechanics, the extremal paths q(t) (3), (4) intersect each other, generically, 
and the set of these paths displays caustics P - ||8| . 

An interesting example of a system where caustics occur is an un- 
der damped nonlinear oscillator driven by a nearly resonant force and by 
weak noise. Such an oscillator is a reasonably good model of a few physical 
systems, including optically bistable systems, and in particular a relativis- 
tic electron trapped in a Penning trap and driven by cyclotron radiation 
| |12| . We emphasize that the onset of caustics in this system is not related 
to bistability that emerges in a comparatively strong field and was investi- 
gated in 1^]. This is seen from the pattern of optimal paths shown in Fig.l. 
The variables qi,q2 are the (dimensionless) coordinate and momentum of 
the oscillator in the rotating frame. The equations of motion in this frame 
are of the form (1) (cf. [^), with 

Ki = q2{ql + ql-l)-'n qi, K2 = -qi{ql + ql - I) - r] q2 + 

Here, r/ is a dimensionless friction coefficient, and (3^^"^ is the dimensionless 
force amplitude (the bistability arises for /3 > rf). 

It follows from the definition of the optimal path as the most probable 
way to reach a given point that, if a point q can be reached along two (or 
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more) paths, only one of them is physically meaningful: this is the path 
that provides an absolute minimum to the action 5(j(q). We show below 
that such a path has not ever touched a caustic. 

We first consider monostable systems, with the attractor a being the only 
steady state in the absence of noise. In this case the auxiliary Hamiltonian 
system has only one fixed point (q = Qaj P = 0). The trajectories (q(t), p(i)) 
(4) emanating from this point at t — > — cxd form a smooth flow (cf. |jl3|) on 
a two-dimensional Lagrangian manifold (LM) |]14|. Except for special cases 
(like detailed balance, V x K = 0) the projections of LM onto the original 
two-dimensional plane ((71,^2) will generally have singularities. 

In two dimensions the only structurally stable types of singularities [^] 
are folds and cusps, as illustrated in Fig. 2. The projections of the folds 
of the LM are caustics. Each cusp gives rise to a pair of folds, and in the 
case under consideration folds can only begin or end at a cusp, or at infinity. 
This pattern is clearly seen in the plot of the optimal paths of a periodically 
driven oscillator in Fig.l, 

It is a feature of the dynamics (3), (4) that the Lagrangian is nonnegative 
definite. Thus, the action always increases along the extremal paths. This 
corresponds, quite naturally, to a decrease in probability density as the 
system moves along the path away from the attractor. An analysis which 
makes use of the normal form of the action near a caustic |14| and of the 



explicit form of the Hamiltonian 7i leads to an explicit local expression for 
the action. From this it can be seen [16| that the action to reach a point 



along a path which has not touched a caustic is always less than that along 
a path which has passed through a caustic. 

Near a cusp from which the caustics are going away (a "direction" of a 
caustic is that of the paths for which the caustic is an envelope) the proba- 
bility distribution can be obtained by modifying the appropriate results of 
the WKB approximation in quantum mechanics Q: 

Paici) oc exp ^ j dP, exp ^ j , 

S{Pi,q2) = -^aiiP^ - ^ai2-Pf 92 - ^0229^- (5) 

Here, (?i,(?2 are the coordinates measured from the cusp point q,, = along 
the directions transverse to, and parallel to the caustics at this point, i.e., the 
velocity of the path in the cusp is pointing along = (q)c = (0, Vc)] Pc = 

— K(qc) + Vc, ai2 = —Vc^, 122 = d (^{2vc)^^ — /dq2 (the derivatives 
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of K are evaluated at the cusp point). The parameter an depends on the 
global features of the flow of the trajectories. It determines how sharply 
the caustics qi = ±2aii((72/3fc)^^^ diverge with the distance from the cusp 
q2- The prefactor in the probability distribution (2) blows up near the cusp 
point like D~^^^. 

For \qi\/D^/'^, \q2\/D^/'^ large and not close to the caustics the integral 
(5) can be evaluated by the steepest descent method, and the action 5a (q) 
in (2) can be expressed in terms of S{Pi,q2) by implying qi = dS/dPi. 
For (72 < the action S'a(q) is single valued. On the other side of the cusp 
point, between the caustics, the action has three values, that is, the surface 
<S'a(q) has three sheets as shown in Fig. 2(c). The top sheet, the one with 
the largest Sa, corresponds to the middle sheet of the LM in Fig. 2(a). It 
is formed by the paths which have been reflected from one of the caustics, 
and contains the path which passes through the cusp point. The two other 
sheets of the surface Sa and of the LM are formed by the paths which have 
not touched a caustic. 

Only the solution with the smallest S'a(q) should be kept in (2) in the 
range of q where the distance between the sheets of 5'a(q) greatly exceeds D. 
Therefore the top sheet of S'a(q) is "invisible" away from the cusp, and the 
trajectories coming to the middle sheet of the LM in Fig. 2 drop out of the 
game. Two lower sheets of the action, S^^ and S^^ , which correspond to the 
lower and upper sheets of the LM, intersect along a line with the projection 
q['\q2) on the q-plane: Si'\q['\q2)) = si^\q['\q2). This line starts at the 
cusp point and lies between the coalescing caustics. There occurs switching 
at this line: the points a small distance from each other, but lying on different 
sides of it are reached along topologically different optimal paths q(t) (those 
providing 5^^^ or sji'^ ) . They approach the switching line from the opposite 
sides. 

The switching line can be immediately observed via experiments [ p!7| ] on 
the probability distribution of the paths q(t) along which the system arrives 
to a given point. If this distribution is measured for various positions of 
the final point, its shape will change sharply once the final point crosses 
over the switching line. We notice that caustics may not be observed via 
experiments of this sort, they are hidden: switching to another path occurs 
prior a caustic being encountered. 

The stationary distribution pa (q) is regular in the vicinity of a switching 
line: away from the cusp point it is given by 
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pM)= E c«(q)exp(-5«(q)/D) (6) 

1=1,2 

where the prefactors are evaluated for the paths lying on the different sheets 
of the LM. However, the derivative of D In pa transverse to the switching 
line is discontinuous in the limit — > 0. This discontinuity was considered 
by Graham and Tel ||l8|, and by Jauslin |^ and Day Q. The switching lines 
were found numerically in |^]. 

It is clear from the above picture that two switching lines emanating 
from different cusp points can end in a point where they intersect each 
other, and then another switching line starts at this point. Therefore there 
arise physically observable trees of switching lines, with the "free" ends at 
cusp points. Yet another conclusion concerns the possibility, expected on 
physical grounds, to reach any point (<?i,<?2) along an optimal path which 
has never touched a caustic. This possibility follows from the fact that 
caustics are the only lines that limit the flow of the optimal paths q(t) in 
the considered case, and they emerge from the cusp points simultaneously 
with the switching lines. In particular the above results provide an insight 
into the switching to a new escape path observed in |8| when the old escape 
path is crossed by a cusp point as a parameter is varied. 

The structure of the singularities becomes more complicated if a system 
has other steady states. A state of particular interest is an unstable station- 
ary state: a saddle point (K(q^) = 0,det[dKi/dqj] < 0, and we assume 
V • K < 0). Saddle points occur on the basin boundaries in multistable 
systems. In such systems, in addition to the characteristic relaxation time 
trei of the deterministic motion (that in the absence of noise), fluctuations 
about initially occupied attractor a are characterized by the reciprocal prob- 
ability W-^ of the noise-induced escape from the basin of attraction. In the 
time interval trei <C t <C the probability distribution /?a(q) is quasista- 
tionary far from the other attractors. We assume the basin boundary (the 
separatrix) to extend to infinity and to contain only one unstable stationary 
point c[s ■ It is the slowing down of the optimal path near q^ that gives rise 
to the effects we discuss. 

The point q = q^, p = is a fixed point of the Hamiltonian equations (4), 
and close to it they can be linearized. We shall enumerate the eigenvectors 
{q(") , p(") } (n = 1, . . . , 4) so that the ones with n = 1, 2 are "fluctuational" , 
p(i>2) _^ while the ones with n = 3,4 are "deterministic", p(^'^) = (the 
solution or (4) with p = corresponds to the deterministic motion, q = K). 
In the vicinity of the fixed point 
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q(t)=q, + X:c(")exp(A(")t)q(") (7) 

n=l 

and similarly p(t) = ^ C^") exp(A(")t)p("); A^^'^-* are the eigenvalues of the 
matrix —dKi/dqj evaluated in the saddle point, and A*^^'^) are their nega- 
tives. We choose 

A(i) > A(3) > 0, A(2) = -A(3), a(^) = -A(^). (8) 

The optimal path of particular importance is the one along which the 
system escapes from the attractor. In a quite general case of a system driven 
by Gaussian noise the most probable escape path (MPEP) |jl^ ends up in 
the saddle point Q. Since MPEP approaches the saddle point as t ^ oo, for 
this path = C^^^ = in (7). The interrelation between the coefficients 
(7(2)^ (^(4) jg determined by the motion far away from the saddle point (in 
special cases, like detailed balance, C^^'^ = 0). Because [A^'')] > |A(2)|, MPEP 
is tangent to q^'^^ in the saddle point (cf. [^] ) , and for q lying on the MPEP 

qxq(2)=Af (q.q(2))\Wxq(2), A=^ (9) 

(we chose the direction of q^^^ such that C^'^^ > for the MPEP). 

For the extremal paths other than MPEP C^^'^^ ^ 0. The coefficients 
are interrelated via the expression 

CWC('^)/CC^)C(^) = r where the 
constant r can be found from the condition that the energy of the Hamilto- 
nian motion E = 0. The paths infinitesimally close to MPEP (|C^^^[ 0) 
and lying on the opposite sides of it approach asymptotically the eigenvectors 
zbq^^) as t — > oo and then go away from the saddle point. The corresponding 
limiting paths form a "cut" of the LM. The singularities related to the cut 
which are of central interest here have not been considered in the analysis 
of the escape probability [|^, |l^ where the absorbing boundary was placed 
along the vector q*^'') (the basin boundary in the absence of fluctuations). 

If the cut was not crossed by other optimal paths emanating from a 
given attractor a it would determine the range that can be reached from 
this attractor along an optimal path. However, crossing of the cut by the 
paths that have not encountered a caustic may occur, and in general, for 
A < 3/2 a caustic emanates from the saddle point tangent to the cut. 
The equation for the caustic d{qi, q2)/d{t, fj.) = (^ is the parameter that 
"enumerates" the paths, the coordinate on a path q = q(t, fj,)) can be solved 
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for small C^^'^) (but \C'^^^ \ exp i^X^^hj < jC^^) | exp (A^^^tj ). The resulting 
interrelation between the coordinates of the caustic transverse and parallel 
to q^^^ is of the form: 



q X q 



(1) 



A 



where a = 1/(2 



A- 1 

A), ; 1< A < 3/2, and 



q(l) X q(2), 



(10) 



C = A(l - A) (p(l) • qW) (q(l) X q(3)) / [(p(2) . q(3)) (qd) x q(2)^ 

Eq.(lO) shows that the caustic is tangent to the cut in the saddle point 
and is described by a simple power law with the exponent 1 < a < 2 de- 
termined by local parameters of the motion near the saddle point. The 
inequality a < 2, or A < | follows from the condition that the corrections to 
(10) due to nonlinearity be small and gives the criterion for the onset of the 
caustic [jl^. The prefactor in (10) depends on the nonlocal characteristic 
M. 

The general conclusion that optimal paths do not encounter caustics 
applies to the caustic emanating from the saddle point as well. The paths 
"beating" the ones approaching the caustic emanate from the saddle point 
themselves. When a system is approaching q^ its motion is slowed down, 
and it spends a time ~ ^1/A^^^^ | lnD| performing small fluctuations about 
q^. Over this time a large fluctuation can occur which will drive the system 
away from q^. It is then necessary to compare the probability to arrive to a 
given q directly from the attractor or via q^, and it can be shown that the 
second scenario wins on the caustic. The switching line emanates from q^ 
and lies between the cut and the caustic. The system arrives on opposite 
sides of it (as well as on the opposite sides of the cut on the other side of 
the saddle point, cf. Fig. 3) directly from the attractor or having reached 
the saddle point first. 

In conclusion, we have established the global structure of the pattern 
of optimal paths for dissipative Markov systems and revealed singular fea- 
tures related to the saddle points. We have shown why and how optimal 
paths avoid caustics. The singularities that can be immediately observed 
experimentally by tracing optimal paths or by measuring the probability 
distribution are switching lines. They start at the cusp points from which 
caustics emanate or at the saddle, and can form trees. 
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Figure 1: Pattern of optimal paths of a periodically driven monostable nonlinear 
oscillator, ry = 0.1 and /3 = 0.0005. 
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Figure 2: Generation of singularities. 
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Figure 3: Saddle point 
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